314 research outputs found
Reinforced Mnemonic Reader for Machine Reading Comprehension
In this paper, we introduce the Reinforced Mnemonic Reader for machine
reading comprehension tasks, which enhances previous attentive readers in two
aspects. First, a reattention mechanism is proposed to refine current
attentions by directly accessing to past attentions that are temporally
memorized in a multi-round alignment architecture, so as to avoid the problems
of attention redundancy and attention deficiency. Second, a new optimization
approach, called dynamic-critical reinforcement learning, is introduced to
extend the standard supervised method. It always encourages to predict a more
acceptable answer so as to address the convergence suppression problem occurred
in traditional reinforcement learning algorithms. Extensive experiments on the
Stanford Question Answering Dataset (SQuAD) show that our model achieves
state-of-the-art results. Meanwhile, our model outperforms previous systems by
over 6% in terms of both Exact Match and F1 metrics on two adversarial SQuAD
datasets.Comment: Published in 27th International Joint Conference on Artificial
Intelligence (IJCAI), 201
KDE Based Coarse-graining of Semicrystalline Systems with Correlated Three-body Intramolecular Interaction
We present an extension to the iterative Boltzmann inversion method to
generate coarse-grained models with three-body intramolecular potentials that
can reproduce correlations in structural distribution functions. The
coarse-grained structural distribution functions are computed using kernel
density estimates to produce analytically differentiable distribution functions
with controllable smoothening via the kernel bandwidth parameters. Bicubic
interpolation is used to accurately interpolate the three-body potentials
trained by the method. To demonstrate this new approach, a coarse-grained model
of polyethylene is constructed in which each bead represents an ethylene
monomer. The resulting model reproduces the radial density function as well as
the joint probability distribution of bond-length and bond-angles sampled from
target atomistic simulations with only a 10% increase in the computational cost
compared to models with independent bond-length and bond-angle potentials.
Analysis of the predicted crystallization kinetics of the model developed by
the new approach reveals that the bandwidth parameters can be tuned to
accelerate the modeling of polymer crystallization. Specifically, computing
target RDF with larger bandwidth slows down the secondary crystallization, and
increasing the bandwidth in -direction of bond-length and bond-angle
distribution reduces the primary crystallization rate.Comment: To be submitted; 31 pages; 8 figure
Interactive Contrastive Learning for Self-supervised Entity Alignment
Self-supervised entity alignment (EA) aims to link equivalent entities across
different knowledge graphs (KGs) without seed alignments. The current SOTA
self-supervised EA method draws inspiration from contrastive learning,
originally designed in computer vision based on instance discrimination and
contrastive loss, and suffers from two shortcomings. Firstly, it puts
unidirectional emphasis on pushing sampled negative entities far away rather
than pulling positively aligned pairs close, as is done in the well-established
supervised EA. Secondly, KGs contain rich side information (e.g., entity
description), and how to effectively leverage those information has not been
adequately investigated in self-supervised EA. In this paper, we propose an
interactive contrastive learning model for self-supervised EA. The model
encodes not only structures and semantics of entities (including entity name,
entity description, and entity neighborhood), but also conducts cross-KG
contrastive learning by building pseudo-aligned entity pairs. Experimental
results show that our approach outperforms previous best self-supervised
results by a large margin (over 9% average improvement) and performs on par
with previous SOTA supervised counterparts, demonstrating the effectiveness of
the interactive contrastive learning for self-supervised EA.Comment: Accepted by CIKM 202
- …